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Abstract. An iterative scheme for solving ill-posed nonlinear equations with 
locally tr-inverse monotone operators is studied in this paper. A stopping rule 
of discrepancy type is proposed. The existence of u ns satisfying the proposed 
stopping rule is proved. The convergence of this element to the minimal-norm 
solution is justified mathematically. 



1. Introduction 
In this paper we study an iterative scheme for solving the equation 
(1-1) F(u) = f, 

where F is a locally cr-inverse monotone operator in a Hilbert space H, and equation 
(jl.ip is assumed solvable, possibly nonuniquely. An operator F is called locally cr- 
inverse monotone if for any R > there exists a constant aji > such that 

(1.2) (F(u)-F(v),u-v) >a R \\F(u)-F(v)f, Vu, v £ 5(0, R) C H. 

Here, (•, •) denotes the inner product in H. If the constant an in (|1.2p is independent 
of R then we call F a cr-inverse monotone operator. 

A necessary condition for an operator F to be cr-inverse monotone is the follow- 
ing: 

WF^-F^WKa-'Wu-vl 

Indeed, inequality (|1.2|) and the Cauchy inequality imply the above estimate. If 
the cr-inverse monotone operator is a homeomorphism, then its inverse is strongly 
monotone: 

(F _1 (u) - F _1 (w), u — v) > cr||M-u|| 2 . 
An example of cr-inverse operator is a linear selfadjoint compact nonnegative- 
dcfinite operator A. Indeed, if Ai > X2 > .... > are its eigenvalues and <pj 
are the corresponding normalized eigenvectors, then 

(Au - Av,u-v) = y^Xjliu - v,</>j)| 2 > cr^ X 2 j\(u - w,^)! 2 = a\\Au - Av\\ 2 , 
j j 

where a = Aj" 1 . An example of locally cr-inverse monotone operator is a nonlinear 
Frechet differentiable monotone operator F : H — >• H provided that H is a complex 
Hilbert space and F' is locally bounded, i.e., for any R > there exists a constant 
M(R) such that 

\\F' (u)\\ < M(R), VueB(0,fl) 
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(see Lemma [2.111 in Section 2). In Lemma [2.111 we also prove that if H is a real 
Hilbcrt space, F : H — > H is a Frechet diffcrcntiable monotone operator and F' is 
a selfadjoint locally bounded operator, then F is also a locally cr-inverse monotone 
operator. If (|1.2p holds, then the operator (JrF satisfies (jl.2[> with <tr = 1. 
It is clear that if F is cr-inverse monotone, then it is monotone, i.e., 

(1.3) (F(u) -F(v),u-v) > 0, Vu,veH. 

It is known (see, e.g., [9]), that the set Af := {it : F(u) = /} is closed and convex 
if F is monotone and continuous. A closed and convex set in a Hilbert space has 
a unique minimal-norm element. This element in J\f we denote by y, F{y) = f, 
and call it the minimal-norm solution to equation (1). We assume that / = F(y) 
is not known but fg, the noisy data, are known, and \\f$ — f\\ < 5. If F'(u) is 
not boundedly invertible then solving equation (|1.1[) for u given noisy data fg is 
often (but not always) an ill-posed problem. When F is a linear bounded operator 
many methods were proposed for solving stably equation (|1.1[) (see and the 

references therein). However, when F is nonlinear then the theory is less complete. 

Methods for solving equation (|1.1[) were extensively studied in [3]-[6], [9]-[l3]. 
In [5J, [3], the following iterative scheme for solving equation (|1.1[) with monotone 
operators F was investigated: 

(1.4) u n+ i = u„ - (F'(u n ) + a n l) 1 (F(u n ) + a„u n - fg), u = uq. 

The convergence of this method was justified with an a apriori and an a posteriori 
choice of stopping rules (see [3])- In [B] a continuous version of the regularized 
Newton method (| 1 .4[) with a stopping rule of discrepancy type is formulated and 
justified. Another iterative scheme with an a posteriori choice of stopping rule was 
formulated and justified in [4]. 

In this paper we consider the following iterative for a stable solution to equation 
(HU): 

(1-5) u n +i = u„ - 7„ [F(u n ) + a n u n ~ f s ] , u Q = u , 

where F is a locally cr-inverse monotone operator, j n 6 (0, 1), n > 0, and uq is a 
suitably chosen element in H which will be specified later. 

The advantages of this iterative scheme compared with (|1.4[) are: 

(1) the absence of the inverse operator in the algorithm, which makes the al- 
gorithm (|1.5|) less expensive than (|1.4p 

(2) one does not have to compute the Frechet derivative of F 

(3) the Frechet differentiability of F is not required. 

A more expensive algorithm (|1.4p may converge faster than (|1.5j) in some cases. 

The convergence of the method (|1.5[) for exact data was proved in [3]. For 
noisy data it was proved in [5] that the element u ns , defined by (|1.5[) and an a 
posteriori choice of stopping rule, converges to a solution to (jl.ip when uq and 
a n are suitably chosen, provided that H is a complex Hilbert space and F is a 
Frechet differentiable monotone operator. However, it is of interest to prove the 
convergence to the minimal- norm solution to (|l.ip . The minimal- norm solution in 
problems with a linear operator F is the solution orthogonal to the null-space of 
F. In linear algebra it is called the normal solution, and it is the solution that is 
of interest in many computational problems. In nonlinear problems the minimal- 
norm solution is also the solution of interest in many cases, because it is often the 
solution with minimal energy. 
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In this paper we investigate a stopping rule based on a discrepancy principle 
(DP) for the iterative scheme (|1.5p . Using the local a- inverse monotonicity of F, 
we prove convergence of the method (|1.5I) to the minimal-norm solution to (jl.ll) . 
The rate of decay of the regularizing sequence a n in this paper is also faster than 
the one in [5]. This saves the computer time and results in a faster convergence 
of our method. The main results of this paper are Theorem 13. 1[ 13.31 and 13.51 In 
Theorem [33] a DP is formulated and the existence of a stopping time n$ is proved. 
The convergence of the iterative scheme with the proposed DP to a solution to 
(|1.1[) is proved in Theorem p. 31) . In Theorem (13.51) sufficient conditions for the 
convergence of the iterative scheme with the proposed DP to the minimal-norm 
solution to (jl.lj) is justified mathematically. 

2. Auxiliary results 
Let us consider the following equation: 
(2.1) F(V a ,s) + aV a , s -f S = 0, a = const > 0. 

It is known (see, e.g., [2] and [9]) that equation (|2.1I) with monotone continuous 
operator F has a unique solution for any fixed a > and any f$ G H. 

Lemmas 12.1) 12.31 and 12.51 can be found in [3] . We include the proofs for the 
convenience of the reader. 

Lemma 2.1. // (jl.2|) holds and F is continuous, then \\V a ,s\\ — O(^) as a — > oo, 
and 

(2-2) lim \\F(V a>s ) - M| = ||F(0)-/ 5 ||. 

a— >oo 

Proof. Rewrite (12.11) as 

F(Va,s) ~ F(0) + aV a , 5 + F(0) - fs = 0. 

Multiply this equation by V a ,s, use the inequality (F(V a ,s) — F(0),V a ,s — 0) > 0, 
which follows from (|1.2[) . and get: 

a\\V a , s \\ 2 < (aV a>s + F(V a , s ) - F(0),V a , s ) = {f s - F(0), V a>s ) < \\fs - F(0)\\\\V a>s \\. 

Therefore, \\V a ,s\\ = 0{\). This and the continuity of F imply ^T^. □ 

Let us recall the following result (see Lemma 6.1.7 9, p. 112]): 

Lemma 2.2. Assume that equation (jl.ip is solvable. Let y be its minimal-norm 
solution. Assume that F : H — > H is a continuous monotone operator. Then 

lim l ||K -2/H =0, 
a— >0 

where V a '■= V a ,o which solves l|2.1[) with 5 = 0. 
Let us consider the following equation 

(2.3) F(V s , n ) + a n V s , n - fs = 0, a„ > 0, 
For simplicity let us denote V n := V§ tTl when (5^0. 

Lemma 2.3. Assume that < (a„)^L \ 0. Then 

(2.4) lim \\F(V n ) - f s \\ < 5. 
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Proof. We have F(y) = /, and 

=(F(V n ) + a n V n - f B ,F(V n ) - fs) 
= \\F(V n ) - fsf + a n (V n - y, F(V n ) - f 5 ) + a n (y, F(V n ) - f s ) 
= \\F(V n ) - Ml 2 + a n (V n - y, F(V n ) - F(y)) + a n (V n - yj - f s ) 

+ a n (y,F(V n )~ f s ) 
>\\F(V n ) - fs\\ 2 + a n (V n -yj-fs) + a n (y,F(V n ) - f 5 ). 
Here the inequality {V n — y,F(V n ) — F(y)) > was used. Therefore 
\\F(V n ) - fs\\ 2 < -a n (V n -yj- f 5 ) - a n { Vl F{V n ) - fs) 

(2.5) < a n \\V n - 2/IHI/ - fs\\+a n \\y\\\\F(V n ) - fs\\ 

<a n S\\V n -y\\+a n \\y\\\\F(V n )- f s \\. 

On the other hand, one has: 

= (F(V n ) - F(y) + a n V n + f- f 5 , V„ - y) 
= (F(V n ) - F(y), V n -y)+ a n \\V n - y\\ 2 + a n (y, V n - y) + (f - f 5 , V n - y) 
> a n \\V n -y\\ 2 + a n (y,V n - y) + (f - f s ,V n - y), 
where the inequality (V n — y, F(V n ) — F(y)) > was used. Therefore, 
a n \\V n - y\\ 2 < a n \\y\\\\V n - y\\ + S\\V n - y\\. 

This implies 

(2.6) a n \\V n -y\\<a n \\y\\+S. 

From (|2.5I) and (|2.6[) . and an elementary inequality ab < to? + j-, Ve > 0, one gets: 

\\F(V n ) - fs\\ 2 <S 2 + a n \\y\\S + a n \\y\\ \\F(V n ) - Ml 

(2-7) i 

<5 2 +a n \\y\\5 + e\\F(V n )-fs\\ 2 + -a 2 n \\y\\ 2 , 

where e > is fixed, independent of n, and can be chosen arbitrary small. Let 
n -> oo so a n \ 0. Then implies lim„^ oc (l - e)\\F{V n ) - f s \\ 2 <S 2 , Ve > 0. 
This implies lim n _ f . 00 \\F(V n ) - fs\\ < 6. 

Lemma 12.31 is proved. □ 

Remark 2.4. Let Vb,„ := Vs, n \s=o- Then F(V .n) + a n Vo, n - f = 0. Note that 

S_ 

a n 

Indeed, from (|2.ip one gets 

F{Vs, n ) - F(V , n ) + a n {Vs.n - V 0<n ) =fs~f- 
Multiply this equality with Vs j7l — Vo, n and use (|1.2p to get: 

5\\V S ,n ~ V^o.nll > (fs - /, V 5 ,n - V , n ) 

= (F(V s ,n) - F(Vo, n ) + a n {Vs, n - V , n ), V 5 , n - V , n ) 
>a n \\Vs, n -V , n \\ 2 . 
This implies (|2.8I) . Similarly, from the equation 

F(V Q . n ) + a n V , n - F(y) = 0, 



(2.8) \\V s , n -V , n \\< 
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one derives that 

(2-9) ||Fo,„|| < ||y||. 

Similar arguments one can find in [5]. 

From (|2.8p and (|2.9p , one gets the following estimate: 

(2.10) iiKii<ro,»ii + -<yi + -. 

From equation (|2.3p one gets 

F(V n +i) - F(V n ) = a n V n - a n+1 V n+ i. 
This and the monotonicity of F imply 

< (a n V n - a n+ iV n +i,V n+ i - V n ) 

(2.11) = -a n \\V n - V n+1 \\ 2 + (a n - a n+1 )(V n+1 ,V n+1 - V n ) 

< -a n \\V n - V n+ i\\ 2 + (a n - a n +i)||K+i||||K+i - V n \\. 

Thus, one gets 

(2.12) \\V n -V n+1 \\ < a "~ a " +1 ||^ w+ i||, Vn>0. 

a n 

Lemma 2.5. Assume ||-F(0) — fg\\ > 0. Let < a n \ 0, F be monotone, and 

la ■= \\F{V n )-f s \\, k n :=\\V n \l n = 0,l,.., 
where V n solves ()2.3p . Then £ n is decreasing and k n is increasing. 
Proof. Since ||F(0) - fs\\ > 0, it follows that k n ^ 0, Vn > 0. One has 
< (F(V n ) - F(V m ), V n - V m ) 

(2.13) = (-a n V n + a m V m , V n - V m ) 

= (a n + a m )(V n , V m ) - a n ||K|| 2 - am||Kn|| 2 - 

Thus, 

< (a„ + a m )(V n ,V m ) - a n \\V n \\ 2 - a m \\V m \\ 2 
< («„ + a m )||K||||F m || - a„||K|| 2 - a m \\V m \\ 2 
" ' = (an||V r w ||-o m ||V r „ l ||)(||V m || - \\V n \\) 

From (|2.3p one gets 
(2.15) £ n = \\F{V n )-f s \\ =a n \\V n \\ = a n k n , n > 0. 

If k m > k n then (|2. 14[) and (|2.15[) imply l n > £ m , so 

dnkn = £n 2^ £ra — dmkm ^* ^mkn- 

Thus, if k m > k n then a m < a n and, therefore, m > n, because a n is decreasing. 
Similarly, if k m < k n then t n < £ m . This implies a m > a n , so m < n. 
If k m — k n then (|2.13p implies 

||^m|| 2 < (V'm, Ki) < IIKJIIIKII = \\V m \\ 2 . 

This implies Vm = V n , and then a„ = a m . Hence, m = n, because a n is decreasing. 
Therefore £ n is decreasing and k n is increasing. Lemma 12.51 is proved. □ 
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Remark 2.6. From Lemma 12.11 and Lemma 12.51 one concludes that 

(2.16) a n \\V n \\ = \\F(V n ) - fs\\ < \\F(0) - f s \\, Vn > 0. 
Let < a(t) € C 1 (K + ) satisfy the following conditions: 

(2.17) 0<a(*)\0, v (t) : =M\o, t > 0. 

a 2 (f) 

Let < h — const and 

a n :— a(nh), n>0. 
Remark 2.7. It follows from ([2T7) that 

1 1 r(n+l)h ■ / s 

(2.18) < = / ^rrrfs < fa/(n) < /m/(0 

fln+l an Jnh a ( s ) 

Inequalities (|2.18p imply 

(2.19) 1 < < 1 +a n hv(0). 

From the relation lim„_ ! . oc a n = and (|2.19|) one gets 

(2.20) lim = 1 

n->oc a n+1 

From (|2~T7l) and (|2~T5| one gets 

(2.21) lim °" ~ a " +1 = 0. 

n^oo a n a n+ i 

Remark 2.8. Let b e (0, 1), c > 1, d > and 

d 



o(t) = 



(c + t) b " 
Then a(f) satisfies ([2TT7| . 

Lemma 2.9. Let < h = const and a(t) satisfy (|2.17[) and the following conditions 
(2-22) a(0)A<2, ^(0) = M < ^. 

Let a n := a(nh) and 



» 7 

(2.23) ^ := £^, n >i, 

i=l 

T/ien i/ie following inequality holds 
n—l 

(2.24) e-v- - a,:+i)||^|l < ^a n \\V n \\, n>l. 
Proof. First, let us prove that 

(2.25) e^'*(a„_i - a n ) < i(a„e ¥> ' 1 - an-ie^™- 1 ), Vn > 1. 
Inequality (|2.25[) is equivalent to 

(2.26) — — > = 2 + e — ~, n>l. 

a n _i e 1 ^™ 
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This inequality is equivalent to 

(2.27) an-i-Qn ^ l-e-^ ^ ^ 
Let us prove (|2~271) . From (|2~T7| and ([2~2"2"|) one gets 

(2.28) ~ °" = r < hu{{n - l)h) < hv{Q) < —. 
a n -ia n J{n-X)h a V s ) 10 

Note that the function f(x) = — - — is decreasing on (0, oo). Therefore, one 
gets 

(2 29) i_f_z: = h ^ > M<ot} > ffl) > = A 

1 ' ^ 3a„ 6 " 6 " 6 " 6 10' 

We have used the inequalities a„/i < a^h < 2, Vn > 1, and /(l) > ^ in (|2.29[) . 
Inequality (|2T2"71) follows from (g]2g) and (|2~2"9"|) . Thus, ([2^23)1 holds. 
From inequality (|2.25[) one obtains 

n— 1 n— 1 

(2.30) 2^e^+ 1 (a i -am) < ^(ame^ +1 -^e^*) < e^"a„, n > 1. 

Multiplying (|2.30|) by i||V„||e~ v '* and recalling the fact that \\Vi\\ is increasing (see 
Lemma |2~5|) . one gets inequality (|2.24l) . Lemma |2~91 is proved. □ 

Lemma 2.10. Let R and an be positive constants and F be an operator in a Hilbert 
space H satisfying the following inequality: 

(2.31) (F(u) -F(v),u-v) > a R \\F(u) - F(v) || 2 , Vu, v £ 5(0, R) C H. 
Assume that 

2 

(2.32) 0<7< — , a = const>0. 

Then 

(2.33) fi(u,v):=\\u-v - — \F(u) — F(v)]\\ < \\u — v\\, Vu,veB(0,R). 

1 — ■ya 

Proof. Let us fix R > and denote a :— an and w := u — v. From (|2.31l) , one gets, 
Vw, v £ B(0, R), the following inequality: 

fi 2 (u, v) = \\w\\ 2 - — ?2— («,, F(u) - + — J^_||F(u) - F(v)\\ 2 



1 — "fa (1 — 7a) 2 

(2.34) < H| 2 - - F(v)\\ 2 + - 7 * \\F(u) - F{v)f 



HI 2 ~ ( ) ll^(«) - F(v)" 2 



l — 7a (1 — 7a) 2 



It follows from ([2~3"2"]) that 



27(7 7 717 



■[2(l- 7 a)-a- 1 7 ] 



( 2 35 x 1-70 (1 - 7a) 2 (1 - 7a) 2 
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Inequality (|2.33p follows from inequalities (|2.34[) and (|2.35j) . Lemma [2. 101 is proved. 

□ 

Lemma 2.11. Let F : H — > H be a Frechet differentiable monotone operator with 
locally bounded F' , i.e., 

(2.36) \\F'{u)\\<M(R), Vu€B(u ,R), 

where H is a Hilbert space. Let one of the following assumptions hold: 

(1) H is a real Hilbert space and F' is selfadjoint, 

(2) H is a complex Hilbert space. 

Then F is a locally a -inverse monotone operator, i.e., for all R > there exists 
a R > such that 

(2.37) (F(u)-F(v),u-v) > <7 R \\F{u) - F{v)\\ 2 , Vu, v £ -8(0, R). 
Moreover, 

(2.38) a R = R>0. 
Proof. Fix u,v € B(0,R). One has 

(2.39) F(u) -F(v) = J{u-v), J := [ F'(v + £(u - v))d£. 

Jo 

By our assumption J is a selfadjoint operator and 

(2.40) 0<J<M(R), M(R):= sup \\F\w)\\. 

weB(0..R) 

This and the selfadjointness of J imply 

(2.41) < J(I - o-rJ) = (I- <t r J)J, , 

where / is the identity operator in H and o~r is defined by (|2.38p . Thus, 

(F(u) — F(v), u — v) = (J{u — v), u — v) 

= (J(u - v), (L - <t r J)(u - «)) + a R \\J(u - v)\\ 2 

(2 42) 

= ([(I-<trJ)J](u-v),(u-v))+<j r \\J(u-v)\\ 2 
>a R \\J(u-v)\\ 2 = a R \\F(u)-F(v)\\ 2 . 

This implies (|2.37|) . Lemma [2.111 is proved. □ 

Remark 2.12. It follows from the proof of Lemma [2jl] that if F'(u) is self-addjoint 
and uniformly bounded, i.e., the constant M — M(R) in (|2.36j) is independent of 
R, then F is a er-inverse monotone operator with a — jj. 

Lemma 2.13. Let < h = const, a(t) satisfy (|2.17[) . a n := a(nh), and 
(2.43) <j) n = hy^a u <P(t):= a(s)ds. 
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Then 

(2.44) e-*»- 1 5^e^(a i -a i+ i)<e a W h e-^ nh W e^ (s) |d(s)|ds, Vn > 1, 



i=0 



(2.45) e-^- 1 V e ^~"' +1 < e «(0)h e -*(»/») / e *M J_^l dS) V n > 1. 

Proof. Let us prove (|2.45[) . Inequality (|2.44|) is obtained similarly. 
Since a„ = a(nh) and < a(t) \, 0, one gets 

n n ,.(fc+l)/i 

<t>n~ 4>i= ^2 a k h > a(s)ds 

k=i+l k=i+l Jkh 



(2.46) 



Ikh 

a(s)ds = (f>{{n + l)h) - <j){{i + l)h), < i < n. 

'(i+l)h 

This and the inequalities 

Ai+l)h Ai+l)h 

(j>{{i + \)h)-(j){s)= J a(s)ds< / a{0)ds < a(0)h, 

J s J s 

for all s £ [ih, (i + l)h], imply 

(2.47) -<t> n -i + <Pi < -<i>{nh) + (f>{s) + a(0)h, Vs £ [ih, (i + 

where < i < n — 1. 

Since < a n \ and |d(t) = — a(t), one obtains 

(2.48) a -i^= r )h ^ ds < r )h ^ ds . 

a i Jih a * Jih a ( s ) 

It follows from Igggj) and (gg7| that 

e-'"-*W' ai ~ ffli+1 < V / e-^-^l^tfa 

(2.49) ^ °* ^ ^ ^ 

< e «(0)h e -^(nh) T' 1 e 0(.) _^ dSj Vn > 1. 

Jo a ( s ) 

Lemma 12.131 is proved. □ 

Lemma 2.14. Let < h = const, a(t) satisfy (|2.17[) , a n — a{nh) and (f> n be as in 
(|2~43| . TTien 

(2.50) lim e^-'on = oo, 

n— »oc 

and 

(2.51) M := lim £?=o e *'(°i ~ ffl i+i) = q 

Proof. Let us first prove (|2.50p . 
From (|2TT7)1 and (|2~4^1) . one gets 

™ /•<» /-oo 2 — d(s) 

(2.52) lim <b n = lim ft, } at> / a(s)ds > / — r — ds = oo. 
«^oo n^oo ^ 7 7 z/(0) a(s) 
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We claim that if n > is sufficiently large, then the following inequality holds: 
(2.53) <j> n -i> In \. 

Indeed, using a discrete analog of L'Hospital's rule, the relation \n(l + x) — x + o(x), 
and (12.211) . one gets 

,. <f> n -l ,. 0n — <f>n-l ,. a n h 

lim =- = lim ; =— = Imi 



In X n^oo In i _ l n i 4 m (i + a "~ a "+ 1 ) 

(2.54) °" 

= lim = 00. 

This implies that (|2 . 53|) holds for all n > N provided that N > is sufficiently 
large. It follows from inequality (|2.53p that 

(2.55) Una a„e^™ _1 > lim a n e °n — lim — ^ = 00. 
Let us prove (12.511) . 

Since ane^™- 1 — > 00 as n — ► 00, by (|2.50p . relation (|2.51[) holds if the numer- 
ator X)™=o e< ^( ai ~ a i+i) m (|2.5ip is bounded. Otherwise, a discrete analog of 
I/Hospital's rule yields: 

», ,. e^'*(a„ - o n+ i) a n -a n+ i 
M = lim — ; ; = lim 



n->oo e Vn a n +\ — e v '»- 1 a I) n->oo a„+i — o„e hari 
(2.56) 1 

< lim — = r = 0. 

(a„-o„ +1 )l i 2 J 1 

Here, we have used (I2.20j) . (|2.21[) . relation lirrin^oo a n = 0, and the following in- 
equality: 

e -ha n < 1 _ kan+ (^0! j V n>0. 
Lemma T2. 141 is proved. □ 

3. Main results 

3.1. An iterative scheme. Let < a(t) G C 1 (M+) satisfy the following condi- 
tions: (see also (|2.17jl ) 

(3.1) 0<a(t)\0, K*):=S\0, t > 0. 

Let < /i = const < 1 and a„ := a(nh),n > 0. Consider the following iterative 
scheme 

(3.2) u n+ i = u n - j n [F(u n ) + a„u n - f s ], u = u Q , 
where iio G H and 

2 

(3.3) < h < j n < — , n > 0, 

a R + 2a n 

where or is the constant in fl 1 . 2H and < R = const. 
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Theorem 3.1. Let a(t) satisfy (13. Assume that F : H — > H is a locally a- 
inverse monotone operator. Assume that equation F(u) = f has a solution, possibly 
nonunique. Let fs be such that \\fg — f\\ < S and Uo be an element of H satisfyinq 
the inequality: 

(3.4) ||F(uo)-M| >C5^ 

where C > and ^ £ (0, 1] are constants satisfying C8^ > 5. Let < R be 
sufficiently large and < h and < 7,1 satisfy (|3.3|) . Let u n be defined by the 
iterative process (13. 2[) . Then there exists a unique ns such that 

(3.5) \\F(u ns ) - f s \\ < \\F{u n ) - f s \\ > C6 C , < n < n s , 
where C and £ are constants from (|3.4p . 

Remark 3.2. In [5] the existence of ns was proved for the choice a n = d/(c + n) b , 
where b £ (0, 1/2) and d > is sufficiently large. However, it was not quantified 
in [S] how large d should be. In this paper the existence of ns is proved for a n — 
dj (c + nh) b , for any d > 0, c > 1, b £ (0, 1), and < h < 7„. This guarantees the 
existence of ns for small a(0) or d. Moreover, our condition on b allows a n to decay 
faster than the corresponding sequence a n in 5 decays. Having smaller a(0) and 
larger b reduces the cost of computations. 

Inequality (13. 4|) is a very natural assumption. Indeed, if it does not hold and 
1 1 Mo 1 1 is not "large", then uq can be already considered as an approximate solution 
to (fTTT|) . 

In general, if R in (|3.3|) is large, then the stepsize h in the iterative scheme (|3.2j) 
is small. Consequently, the computation time will be large since the rate of decay 
°f { a n)n°=i i s slow. However, if F is tr-inverse monotone, i.e., an is independent of 
R, then it is easy to choose h and 7„ to satisfy (|3.3[) . 



Proof of Theorem \3.1{ Let us prove first that there exists R > such that the 
sequence (w n )^Li remains inside the ball B(0,R). 

We assume without loss of generality that S £ (0, 1). It follows from (|2.16j) and 
the triangle inequality that 

(3.6) a„||K|| < \\F(0)-fs\\ < \\F(0)-f\\ + \\fs-f\\ <T, Vn > 0, V<5 £ (0, 1), 
where 

T:= ||F(0)-/|| + 1. 

From (13.61) one obtains 



(3.7) HK||<— , Vn>0. 
Let 4>(t) be defined as follows (see also (|2.43|1 ) 

(3.8) (j){t) = [ a(s)ds. 

Jo 

From the last inequality in (|2.52j) one gets 

(3.9) lim <j)(t) = 00. 

t— >oo 

We claim that 



Jo e ^t?r 



(3.10) lim = 0. 
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Indeed, if the denominator J* e^ s ^ ds is bounded, then (|3 . 10[) is valid because 
limt^oo 4>(t) = oc. Otherwise L'Hospital's rule and (13. If) yield 



(3.11) 
Let 
(3.12) 



JO e a(s) Ub 



Km - — j _ = iim e ::: i y )| = . 



o 0(t) 



3 0(t)| 



o(0)„-*( 



if = 1 + supe aw e 



"/ 

A) 



a(s) 



It follows from (I3.10[) that if is bounded. 
Let Vs(t) solves the equation 



(3.13) F(V s (t)) + a(t)V s (t) -f s = 0. 
It follows from Lemma \2. 5 1 that 

(3.14) \\F(V s (t))-f s \\<\\F(V n )-f s \\, Mt>nh. 

Relation (|3.10j) . Lemma l2~3l and (|3 . 14|) imply that there exists T > such that the 
following inequality holds V* € [T, T + 1]: 



|;W))-/ 5 || + e -<^o 



(3.15) 

where 
(3.16) 
Let 
(3.17) 
Let 



e a(O) e -0(t) 



d(s) 



LA" 
o(s) 



w 



ds < C<5 C , 



ip = \\F(u ) + a u - f s \\, w = \\u -V \\. 



R:= \\V s (T)\\K + w . 

2 

< h < min(l, 



g r 1 + 2a(0) 



Let N be the largest integer such that Nh < T. Let us prove by induction that the 
sequence {u n )^ =1 stays in side the ball B(Q,R). To prove this it suffices to prove 
that 



(3.18) 



IK-KH < w + \\V n \\(K-l), n = 0,l,...,N. 



Inequality P~Tg|) holds for n = 0, by ([3TT5|1 . Assume that (j3~T%l) holds for < n < 
N. Let us prove that (|3.18[) also holds for n+ 1. 
It follows from equation p. 21) that 



Mn+l -V n = U„ - V n - 7„ 



(3.19) 



F(u n ) + a„u„ - F(V n ) - a n V» 



u„ - V n 



In 



1 - 7"«n 



= (1 - 7„a„) 
This and Lemma 12.101 imply 

(3.20) ||U„ +1 - < \\u n - V n \\(l - lna n ) 



(F(u n ) - F(V n )) 
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From p.20|) . the triangle inequality and (|2.12|) one gets 

\\u n +l - V n +l\\ < \\u n - V n \\(l - 7 n a«) + \\V n +l ~ V n 
( 3 - 21 ) ^ ii.. „ ii -ha„ , a n -a n +i 



< u n - V n \\e~ na " 



-\\Vr 



n+1 



Here we have used the inequality: 1 — j n a n < e hcin where < h < j n and n > 0. 
From p.2ip one gets by induction the following inequality: 



(3.22) ||«7i+i - Vn+iW < woe" 

where 



L * rt: 



1=1 



(f> n = / I hat, n>0. 

i=0 

From ()3.22j) . Lemma l2~5| Lemma T2.131 and p,12j) . one obtains 

n 

K+i - K + i|| < w + \\V n+1 \\e-^J2 e ^ ai ~ ai+1 



i=l 



(3.23) 



<w + \\V n+1 \\e a ^e-^ n+1 ^ 
<w Q + \\V n+1 \\(K -I), 



(n+l)h 



a{s) 



where <p(t) is defined by ([37 

Hence, (f3TT8]) holds for n + 1. Thus, by induction ff3TT8]) holds for < n < 
N. Inequalities (j3~18| . ([337]) . and the inequality \\V n \\ < \\V S {T)\\, Vn < N (see 
Lemma [2~5|l . imply that the sequence (u n )n=i remains inside the ball B(0,R) 

Let us prove the existence of n$ . 

Denote g n := g n j '■= F(u n ) + a„u n — fg. Equation (|3.2p can be rewritten as 



(3.24) u n +i - u n = -Jn9n, n>0. 

This implies 

9n+i =9n + a n+ i(u n+ i - u n ) + F(u n+ i) - F(u n ) + (a n+ i - a n )u n 

Un+l - U n 



(3.25) 



In 

+ (dn+l ~ a n )u n 

_ 1 — Trtgn+l 
In 

+ (ctn+1 - a n)u 



+ a n+1 (u n+1 - u n ) + F(u n+ i) - F(u n ) 



(U n +1 ~ U n ) - (F(u n+ l) - F(u n )) 

1 - "fnCLn+1 



Denote ip n = \\g n \\- It follows from (|3. 251) that 



1 — 7„a„ + i 
(3.26) " 7n 



(«n+l - Un) 



In 



1 — 7« a n+l 



(F( Mn+1 ) - F(u„)) 



+ {a n - a n+ i)||u n ||. 
From Lemma \2. 101 and f|3 . 24[) we get the following inequality: 



(3.27) 



[U n +l - U n ) 



Jn 

1 - InOn 



+ 1 



■(F(u n+ l) -F(u n )) 
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for all < n < N - 1. From (pO?) and (|3~26| one gets 

(3.28) ^+i < (1 )tp n + (a 

Note that one has: 1 — ha n+1 < e~ an+1 , Mn > 0. This, inequalities (|3.28[) and 
(j3~Tgf imply 

(3.29) Vn+i <e- an+lh ip n + {a n -a n+ i)(\\V n \\K + w ), 0<n<N-l. 
From inequality (|3.29p one gets by induction the following inequality: 

n-l 

(3.30) ip n < iPoe-^- 1 + e~^^e <l>i {a i -a i+l ){\\V j \\K + w Q ), 1 < n < N, 

where 4> n is defined by (|3.8[) . 

Since F(K) + a n V„ - / A - = 0, one gets 

(3.31) g n = F(u n ) ~ F(V n ) + a n {u n - V n ). 
This and (fl~3| imply 

(3.32) a„\\u n - V„\\ 2 < (g n ,u n - V n ) < \\u„ - V n \\ip n , 
and 

(3.33) \\F(u n ) -F(V n )\\ 2 < (g n ,F(u n )-F(V n )) < i> n \\F(u n ) - F(V n )\\. 
Inequalities (|3.32l) and (j3.33[) imply 

(3.34) a n \\u n -V n \\ < V>„, ||FK)-F(K)|| < V'n- 

From (|3.30[) . and Q3.34p . one gets, for < rt < N, the following inequality: 

n-l 

(3.35) ||F(u„) - F(K)|| < Voe- '- 1 + e~*»- 1 £ e^(a t - a i+1 )(||^||K + w ). 

i=0 

This, the triangle inequality, and inequalities (|3 . T[) imply 

lift"..) - All <I|F(V.,) - /sll + <I»e-*"-' 



e-^n-x ^ e 0, ( a . _ a . +1 ) ^_ + WQ j j <n< N. 



i=0 

From (|3.8[) and the fact that a(t) is decreasing one gets 

n-l „ n h 

(3.37) (j>n-i = ha(ih) > / a(s)ds — 4>(nh), n > 1. 

Inequality (|3~36l) with n = N, equation (|3TT7|i . the inequality T - 1 < Nh <T, 
by the definition of TV, and Lemma 12.131 imply 

\\F(u N ) - M| <||F(^(A^)) - M| + Voe"^ 



Jo V a ( s ) J 



This implies the existence of ng. 

The uniqueness of n$, satisfying (|3.5|) . follows from its definition (|3.5p . 
Theorem 13. II is proved. □ 
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Theorem 3.3. Let F, f, fs and us be as in Theorem \3.1\ and and y be the minimal- 
norm solution to the equation F(u) = f. Let < {5 m )m=i be a sequence such 
that 5 m — > 0. If the sequence {ns m }m=i * s bounded, and {n mj }°°^ 1 is a convergent 
subsequence, then 

(3.39) lim u nm , = u* , 

where u* is a solution to the equation F(u) — f . If 

(3.40) lim n m = oo, 

and £ € (0, 1), then 

(3.41) lim \\u nm -y\\=0. 



m— >oo 



Proof. Let us first prove (|3.4ip assuming that (|3.40l) holds. For simplicity we will 
prove that 

(3.42) lim K \\us - y\\ = 0, 

under the assumption that 

(3.43) lim n$ — oo, 

From (|3.43[) . Lemma r2.14[ and the fact that the sequence (||^i||)^Lo ^ s increasing, 
one gets the following inequalities for sufficiently small S > 0: 

(3-44) Voe"^- 2 < ^-ilMI < Ja„,-i||K,-i||, 

and 

(3.45) e"^- 2 e^{a t ~a l+1 )(\\V l \\+K) < -a„,_i||K,_i||. 

i=0 

From (|3~5|) , and (f3T36|) with n = ns - 1, ([3~44|) and (f3T45]) . one obtains 

(3.46) C6< < ^-iH^-ilKl + \ + \) < ^L^xWyW + s\ 

for all < 5 sufficiently small. This and the relation lim^o 4- = oo for a fixed 
C 6 (0, 1) imply 

(3.47) llmsup _.<ZM < £M. 

Inequalities (|3.47[) . S < C8^, and (|2.10p imply, for sufficiently small S > 0, the 
following inequality 

(3.48) \\V n \\<\\y\\ + — <C:=\\y\\+2\\y\\, 0<n<n s . 
Using estimate (13.481) . one obtains: 

(3.49) lim ^eHa.-a^mW < & ^ 

It follows from (l23Tj) and (|3T4^) that 

(3.50) fa nS 1 «*(--°m)WI =a 

5^0 
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From (pT3U)l and one gets 

(3.51) IK-KH < 6 +^^Y / e-*>(a l -a l+1 )(\\V t \\K + w ). 



i=0 



This, ^Hl , and f3~50")) one obtains: 

(3.52) lim ||u nj - KJh 
It follows from ([3~T7|) that 

(3.53) lim = 0. 

■5^0 a n , 



From the triangle inequality and inequality (I2.8[) one obtains: 

IK, - 2/11 < IK, - K s II + \\V ns - V Q<ns \\ + \\V , ni - y\\ 

(3 ' 54) < \Wn s -V ns \\+-^ + \\V 0<ns -y\\. 

Note that V , ns = V a (n s ),o (cf. 1(21)1 )■ From (|3"32"j) - ((3~54l) . (pE33]) . and Lemma 
one obtains (|3.43l) . 
Let us prove (|3.39|) . 

If n > is fixed, then u n is a continuous function of /j. Denote 

(3.55) u* := u* N := lim u nj , 

where 

(3.56) lim n mj = N. 

J-KX) 

From (|3.55p and the continuity of F, one obtains: 

(3.57) ||F(u*) - /|| = lim \\F(u ndm _) - f s \\ < lim C& = 0. 

j— >oo J J J— >oo J 

Thus, u* is a solution to the equation F(u) — f, and (|3.39[) is proved. 

Theorem 13.31 is proved. □ 



(3.58) 2>a(0), „(0) = 1^ < 



Let us assume in addition that a(t) satisfies the following inequalities 

KQ)I < i 

a 2 (0) " 10' 
Remark 3.4. Let b € (0, 1), c > 5, d > and 

d 106 , h 

a(i) = 7 - 7: , — r<d<2c ft . 

Then a(t) satisfies ([2TT7| and J33S}. 

We have the following result 

Theorem 3.5. Let a(t) satisfy (|2.17[) and (|3.58p . Let F,f,fs and us be as in 
Theorem \3.1\ Assume that uq satisfies either 

(3.59) ipo=\\F(uo) + a uo- f sW^eS*: , < 6 < C, 

or 

(3-60) ||F(« ) + a u Q - f s \\ < la \\V \\. 
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Assume ( € (0, 1). Then 

(3.61) lim ns = oo. 

<5->o 

Remark 3.6. The element uq satisfying (|3.59j) can be obtained easily by the following 
fixed point iterations: 

(3.62) v n+ i = v n - j(F(v n ) + a v n - f$), n > 0, 
where vq £ B(0, R), < R is sufficiently large, and 7 is chosen so that 

(3.63) 0< 7 <— A— • 

a R + 2a 

Note that the operator G(v) :— v — j(F{v) + ciqv — f$) is a contraction map by 
Lemma 12.101 

Inequality (|3.60[) is a sufficient condition for the following inequality to hold (see 
also ()3.76|) below) 

(3.64) e-^ <^a n \\V n \\, t > 0. 

By similar arguments as in the proof of Lemma 12.141 one can prove that 

lim e Vn a n = 00. 

n— >oo 

In the proof of Theorem 13.51 inequality (|3.64[) (or (|3.76jl ) is used at n = ng. The 
stopping time ns is often sufficiently large for the quantity e^ n *a ns to be large. In 
this case inequality (13.761) with n — ns is satisfied for a wide range of Mo- 
lt is an open problem to choose £ (see (|3.4[1 ) which is optimal in some sense. In 
practice it is natural to choose C and £ so that C6^ is close to 6. It is because if v 
is a solution to the equation F(u) = /, then ||.F(v) — fs\\ = 11/ — fs\\ _■ 



Let us now prove Theorem [ 

Proof of Theorem\?[J% Let us prove (pTrJTj) assuming that (|330l holds. When (|3~59"li 
holds, instead of (|3.60p . the proof follows similarly. 

It follows from (|3.28j) . the triangle inequality, and (|3.34[) that 

4> n +i < (1 - ha n+ \)i> n + (a n - a n+ i)||u„ - V n \\ + (a„ - a„ + i)||V„|| 
< (1 - ha n+1 )ifj n + — ^-^-ip n + (a n - a n+1 )\\V n \\, 

for < n < ns - 1. From (j2~T5f and (|3"35)) one gets 

11 aa\ if, a n - a n+ i ha n+1 - h °"+i 

(3.66) 1 — na n+1 H < 1 < e 2 . 

a n 2 

From p.65|) and (|3.66|) one obtains 

(3.67) -0n+i < e 2 V« + (a n - a n+ i)\\V n \\. 
This implies 

n-l 

(3.68) Vn<e- v "V'o + e-^^e-^(a J -a i+ i)||V;||, 1 < n < n 4 . 

i=0 

where 

ha n 



(3.69) = 53 ' 



i=l 
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> a n \\V n \\ - iioe^ - e^" ^ e^ 1 (a t - a t+1 



It follows from the triangle inequality, (|2.15|) . p.34|) . and (|3.68|) that 
\\F(u n ) - M| > \\F(V n ) - M| - \\F(V n ) - F(u n )\\ 

(3.70) 

d. «n|| fjill - Wo e ' - - e 

i=0 

From Lemma 12.91 one obtains 

- n— 1 

(3.71) 2 a " l|K|1 ^ e " V "I] eVi+1 (ai-«i+i)ll^||. 

i=0 

From the relation ij) n = ||F(w„) + a n u n — Ml (cf. (|3.31[1 ) and p.60[) one gets 

(3.72) Voe" v " < |ao||T^ol|e-^", n > 0. 
It follows from (12TP7|) that 

(3.73) ai < an+ie^™, Vn > 0. 

Indeed, inequality a\ < o„+ie v " is obviously true for n = 0, and a n+ ie v ™ is an 
increasing sequence because 



an+ie^" - a n e v " 1 =e v "- 1 (a„ + ie 2" - a n ) 

2 



(3.74) > e Vn 1 (a n +i + -^a«+i - «n) 



= e Vn 1 a„a„ + i(- ) > 0, 

I a n a n+ i 

by (|2"Tgj) and ([335]l . From (|37f5j) . ([335)) and ([2TT5)) one gets 

(3.75) e~ v "ao < a„+i— < 2a„ + i, n > 0. 

ai 

Inequalities p.72[) and (13.75)) imply 

(3.76) e-^Vo < ifl^+iUVoll < \a n \\V n \\, n > 0, 

where we have used the inequality ||V^,/ 1| < || V ra || for n' < 11, established in Lemma [2~5l 
From p~70l) . (j3~7T|) and ([3^6]) . one gets 

Il-Ffanj ~ ^11 > OnJIKJI - ^OnjUKwII ~ ^"J^H = ^nJKJ- 

This and (|3.5I) imply 



C6< > \\F(u ns ) - f s \\ > \a ns \\V ns \ 



Thus, 



(3.77) lim a ns \\V ns || < lim 4C5 C = 0. 

S— >0 5— >0 



From (|2.8p and the triangle inequality we obtain 

(3.78) a ns \\V 0tnt \\ <o n ,||V n ,||+a n ,||K w -V ,n,|| < a ns \\V ns \\ + 6. 

This and (j3~77|) imply 

(3-79) lima„,||Vb >ns || =0. 
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Since ||Vo,n 5 > ll^b,o|| > 0, relation (|3.79j) implies lim^o o-ns = 0. Since < a n \ 
0, it follows that (plJT]) holds. 

Theorem 13.51 is proved. □ 

Instead of using iterative scheme (|3.2[) one may use the following iterative scheme 

(3.80) u n+ i = u n -Jn[F(u n ) +a n (u n - u) - fs], Uq = U 0i 

where u,uq G H. Denote F(u) := F(u + u). If F is a locally cr-inverse monotone 
operator then so is F. Using Theorem 13.11 with F :— F, one gets the following 
corollary: 

Corollary 3.7. Let a(t) satisfy (|2T7|) and ([3351) . Let < R = const be sufficiently 
large and h and 7„ satisfy p.3[) . Assume that F : H — >• H is a locally cr-inverse 
monotone operator, and uq is an element of H , satisfying inequality 

(3.81) [[^(no) - fs\\ > C6< > 6, 

where C > and < £ < 1 are constants. Assume also that uo satisfy either 
\\F(u Q ) + a (u Q -u)-fs\\< -a \\V \\, 

or 

||F(u ) + M u o -u)-fs\\< OS'', 0<9 = const < C. 

Assume that equation F(u) = f has a solution, possibly nonunique, and z G 
B(uq, R) is the solution with minimal distance to u. Let fs be such that /| < 5. 
Let u n be dehned by (|3.80|) . Then there exists a unique ns such that 

(3.82) \\F(u ns )-f s \\<C5<, \\F(u n )-f 5 \\ >CS C , 0<n<n 5l 
where C and ( are constants from (13. 4ft . If £ € (0, 1) and ns satisfies ()3.5j) . then 

(3.83) lim L||u n , - z]| = 0. 

o— >U 

3.2. An algorithm for solving equations with cr-inverse operators. Let us 

formulate an algorithm for solving equations with cr-inverse operators. 
Algorithm 1 

(1) Estimate the constant a = ur in (|1.2j) . 

(2) Choose an a(t) satisfying (|2.17|) . 

(3) Choose h — ff -i_ | 2 2 a(o) anc ^ ^ n to sat i s fy conditions (|3.3[) . 

(4) Find an initial approximation «o for y or simply set uq = 0. 

(5) Compute «„ by formula (|2.21[) . use (|3 . 5() to stop the iterations at ns and 
use u nj as an approximate solution to the equation F(u) = f. 

Theorem [33] guarantees the convergence of u ns , computed by Algorithm 1, to, 
at least, a solution to F(u) = f. If the equation F(u) = f has a unique solution, 
then u ns converges to this unique solution. 

If one chooses a(t) to satisfy (I3.58|) in addition, and u to satisfy (|3.59l) or (|3.60l) . 
then ns — > oo as 8 — > as proved in Theorem 13.51 Consequently, u ns converges to 
the minimal- norm solution y as stated by Theorem 13. 31 

Note that the element uq satisfying (|3.59[) can be found from iteration (|3.62[) . 
Mover, in practice ns is often large when S is sufficiently small. Thus, in practice 
one can also use mq = as pointed out in Remark [3T6l 
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Algorithm 1 can also be implemented for solving equations with locally a- 
inverse operators. Since the constant <jr depends on R, one should choose R suffi- 
ciently large so that the sequence (u n )™=i remains in side the ball B(0, R). However, 
if one chooses R too large then h and 7„ satisfying (|3.3[) are small. Consequently, 
the computation cost will be large. Thus, R should be chosen not too small so that 
the sequence (u n )^f_ 1 remains in side the ball B(0, R) and not too large so that the 
computation cost is not large. The choice of R varies from problems to problems. 

4. Numerical experiments 
Let us do a numerical experiment solving nonlinear integral equation with 

(4.1) F(u) := B(u) + arctan 3 (w) := / e~\ x ~ y \u{y)dy + arctan 3 (w). 

Jo 

The operator B is compact in H = L 2 [0, 1]. One has 

(arctan 3 u — arctan 3 v, u — v) = / (arctan 3 u — arctan 3 v)(u — v)dx > 0, 

Jo 

and 

-i poo i\x f i 



d\=\-T~ l (x), 

7T J_ oc 1 + A 2 V 7T V! + A / 

where T denotes the Fourier transform. Therefore, {B(u — v), u — v) > 0, so 
(F(u) -F(v),u-v) > 0, Vu,v€H. 
The Frechet derivative of i 7, is: 

3 arctan 2 it , Z" 1 



(4.2) F»fe= U h+ / e -l^l%)^. 

It follows from (|4.2[) that F' is sclfadjoint and uniformly bounded. Thus, F is a 
cr-inverse operator. Moreover, one can prove that 

„ ... rl 3 arctan 2 a; /2 

F'(u) < \ — H sup <1 + V«eF 

V 7r 1 + a; 2 V 7r 

This and (|238]l imply that 



Vr<1 + \J\ Vi?>0. 



Thus, if a(0) < 1 — y ~, then (|3.3|) holds for 7„ = h = 1. Therefore, the existence 

of n<5 is guaranteed with a„ = ( 5 _^ju.in> and 7„ = 1 by Theorem |3Tj It follows from 
(|4.ip that equation F(u) — f has not more than one solution for any / E H. Thus 
if (Sm)m=i is a sequence decaying to and ri5 mj is any convergent subsequence of 
ns m , then one gets u ns — > y, the unique solution to F(u) — f, by Theorem 13.31 

If u(x) vanishes on a set of positive Lebesgue's measure, then F'(u) is not bound- 
edly invertible. If u G C[0, 1] vanishes even at one point xo, then F'(u) is not 
boundedly invertible in H . In this case equation F{u) = f cannot be solved by 
classical methods such as Newton's method or Gauss-Newton method. 

Let us use the iterative process p.2[) : 

U n+ i = U n - ~/ n [F(u n ) + a n U n - fs], 

4.3 n 
u = 0. 
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We stop iterations at n := ns such that the following inequality holds 

(4.4) \\F(u ns )-f s \\ < C5 C , \\F{u n )-f s \\ > C<5 C , n < n s , C > 1, Ce(0,l). 

Integrals of the form J* e~\ x ~ y \fi(y)dy in (14.11) and (|4. 2[) are computed by using the 
trapezoidal rule. The noisy function, used in the test, is 

fs(x) = f(x) + K.fnoise{x), K = k(S) > 0. 

The noise level S and the relative noise level are defined by 

S = K || fnoise (x) ]|, S re i := — . 

The constant n is computed in such a way that the relative noise level S re i equals 
to some desired value, i.e., 

s _ Ml/ll 

|| fnoise (^) || ||/nozse|| 

We have used the relative noise level as an input parameter in the test. 

In all figures the a;- variable runs through the interval [0, 1], and the graphs rep- 
resent the numerical solutions udsm{x) and the exact solution u exact (x). 

As we have proved, the iterative scheme converges to the minimal-norm solution 
when a„ = ( 5+ ^ ra )& , b e (0, 1), < d < 2 x 5 1_b and j n are "sufficiently" small. 
The choice of 7„ depends on the problem one wants to solve because j n depends 
on an which varies from problems to problems. Note that if one chooses 7„ to be 
too small, then one needs many iterations in order to reach the stopping time ns in 
(|4.4p . Consequently, the computation time will be large in this case. For er-inverse 
problems where the constant a = or can be estimated then it is not difficult to 
choose 7„ satisfying (|3.3j) . 

In the numerical experiments we found that our method works well with a(0) 6 
[0.1, 1]. In the test we chose a n by the formula a n : — ^ where fl(0) — 0.1 and 
C = 0.99. We carried out the experiments with 7„ = h = const € (0, 1], and the 
method works well with this choice of j n . If one chooses h > too small, then it 
takes more computer time for the method to converge. The number of node points, 
used in computing integrals (|4.1|) and (|4.2|) . was N = 100. In all the experiments, 
the exact solution is chosen as follows 

, , _ /Q if ie [0,0.5) 

UeaoctW-^! . f 2, £ (0.5,1]. 

As we have mentioned above, F'(u) is not boundedly invertible in a neighborhood 
of u exact . In particular, F'(u exac t) is not boundedly invertible. Thus, one can not 
use classical methods such as Newton's method or Gauss-Newton method to solve 
for u exact . 

Numerical results for various values of S re i are presented in Table Q] From 
Table Q] one can see that the number of iterations ns tends to go to oo as S goes to 
0. Numerical experiments showed that ns —> oo as S — » 0. Note that our choice of 
a(t) in this experiment does not satisfy condition (I3.4[) which is a sufficient condition 
for having ns — > oo as S — >• 0. Table Q] shows that the iterative scheme yields good 
numerical results. 

Figure [1] plots the numerical results when relative noise levels are S re i — 0.01 and 
Srei = 0.001. The noise function in this example is a normally distributed random 



22 N. S. HOANG 



Table 1. Results when a(0) = 0.1 and h = 1. 



Srel 


0.05 


0.03 


0.02 


0.01 


0.003 


0.001 


Number of iterations 


5 


6 


8 


13 


39 


104 


ll«DSJf-«i!iiirf II 
\\u ej: act 1 


0.166 


0.111 


0.108 


0.076 


0.065 


0.045 



vector of length N with mean and variance 1. Here N is the number of nodal 
points used in discretizing the interval [0, 1]. 




Figure 1. Plots of solutions obtained by the iterative scheme 
when N = 100, S re i = 0.01 (left) and S rel = 0.001 (right). 

Figure [2] plots the numerical results when the noise levels are 8 re i = 0.01 and 
Srel = 0.001. In this experiment we choose the noise function by the formula 
fnoise{x) = sin(37ra;), x £ [0, 1]. 

In computations the functions u, f and fs are vectors in M. N where N is the 
number of nodal points. The norm used in computations is the Euclidean length 
or L 2 norm of R N . 

We have also carried out numerical experiments with a n = ^ 5+ ^y,M> ■ F° r this 
choice of a n the convergence of u ns to the unique solution of the problem is guar- 
anteed by Theorem 13 . 1 1 15751 However, the numerical experiment showed that using 
this choice of a n does not bring any improvement in accuracy while requiring more 
time for computation. Experiments also showed that for this problem it is better 
to use a n = (5H ^°L 3 with a(0) G [0.1, 1]. 

From the numerical results we conclude that the proposed stopping rule yields 
good results in this problem. 
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